Isotonic Median Regression via Scaling

نویسنده

  • Quentin F. Stout
چکیده

This paper gives algorithms for determining isotonic median regressions (i.e., isotonic regression using the L1 metric) satisfying order constraints given by various ordered sets. For a rooted tree the regression can be found in Θ(n log n) time, while for a star it can be found in Θ(n) time, where n is the number of vertices. For bivariate data, when the set is a grid the regression can be found in Θ(n log n) time, while for general sets it can be found in Θ(n log n) time. For vertices in d-dimensional index space, d ≥ 3, the regression can be found in Θ(n log n) time for general placement. When there are multiple data values per point, with N total values, the regression for tree and bivariate grid orders can be determined in Θ(n log n +N log logN) time. Most of the algorithms are based on a scaling approach which exploits the fact that L1 regression values can always be chosen to be data values.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Fast Scaling Algorithm for Minimizing Separable Convex Functions Subject to Chain Constraints

In this paper, we consider the problem of minimizing j j j N C (x ) ∈ ∑ , subject to the following chain constraints l ≤ x1 ≤ x2 ≤ x3 ≤ ... ≤ xn ≤ u, where Cj(xj) is a convex function of xj for each j ∈ N = {1, 2, ..., n}. This problem is a generalization of the isotonic regression problems with complete order, an important class of problems in regression analysis that has been examined extensi...

متن کامل

Algorithms for L∞ Isotonic Regression

This paper gives algorithms for determining L∞ weighted isotonic regressions satisfying order constraints given by a DAG with n vertices and m edges. Throughout, topological sorting plays an important role. A modification to an algorithm of Kaufman and Tamir gives an algorithm taking Θ(m log n) time for the general case, improving upon theirs when the graph is sparse. When the regression values...

متن کامل

Strict L∞ Isotonic Regression

Given a function f and weightsw on the vertices of a directed acyclic graphG, an isotonic regression of (f, w) is an order-preserving real-valued function that minimizes the weighted distance to f among all order-preserving functions. When the distance is given via the supremum norm there may be many isotonic regressions. One of special interest is the strict isotonic regression, which is the l...

متن کامل

A Faster Algorithm Solving a Generalization of Isotonic Median Regression and a Class of Fused Lasso Problems

Many applications in the areas of production, signal processing, economics, bioinformatics, and statistical learning involve a given partial order on certain parameters and a set of noisy observations of the parameters. The goal is to derive estimated values of the parameters that satisfy the partial order that minimize the loss of deviations from the given observed values. A prominent applicat...

متن کامل

An Empirical Comparison of Supervised Learning Algorithms Using Different Performance Metrics

We present results from a large-scale empirical comparison between ten learning methods: SVMs, neural nets, logistic regression, naive bayes, memory-based learning, random forests, decision trees, bagged trees, boosted trees, and boosted stumps. We evaluate the methods on binary classification problems using nine performance criteria: accuracy, squared error, cross-entropy, ROC Area, F-score, p...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009